Search AI Products and News

A recent study released by the University of Munich, the Munich Machine Learning Center, and Adobe Research shows that 12 top AI language models, including GPT-4o, Gemini1.5Pro, and Llama-3.3-70B, face significant performance degradation in long-text conceptual reasoning tasks. Despite these models supporting context processing of at least 128,000 tokens, their ability to establish deep logical connections still has fundamental limitations. The research team developed NOLIMA (No Text Matching).

In recent years, large language models (LLMs) have made significant progress in the field of natural language processing (NLP), widely applicable in scenarios such as text generation, summarization, and question answering. However, these models rely on a token-level processing method that predicts word by word, which struggles with contextual understanding and often leads to inconsistent outputs. Moreover, when scaling LLMs to multilingual and multimodal applications, the computational costs and data requirements tend to be relatively high. To address these issues, Meta AI has proposed a novel approach.